Acquirement of cross-modal correspondence from mere experience

Acquired and inherited forms of cross-modal correspondence

Coloured hearing synaesthesia (from the Greek syn [union] and aisthesls [sensation]), has been known to the scientific community for over 300 years and yet has gone relatively unlnvestigated. In this revlew we chart recent research Into the various forms of synaesthesia and contrast accounts of acquired and developmental forms of the condition. We also revlew the competing theories proposed to ...

Deep Self-Convolutional Activations Descriptor for Dense Cross-Modal Correspondence

We present a novel descriptor, called deep self-convolutional activations (DeSCA), designed for establishing dense correspondences between images taken under different imaging modalities, such as different spectral ranges or lighting conditions. Motivated by descriptors based on local self-similarity (LSS), we formulate a novel descriptor by leveraging LSS in a deep architecture, leading to bet...

Deep Self-correlation Descriptor for Dense Cross-Modal Correspondence

Introduction to Modal Correspondence Theory

Correspondence Matching with Modal Clusters

—The modal correspondence method of Shapiro and Brady aims to match point-sets by comparing the eigenvectors of a pairwise point proximity matrix. Although elegant by means of its matrix representation, the method is notoriously susceptible to differences in the relational structure of the point-sets under consideration. In this paper, we demonstrate how the method can be rendered robust to str...